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An asaessment study was conduated to test the 
erfectiveness of 'the Career llanning Support System (CPSS) materials 
that were developed to proviae systematic program planning for high 
school caraer development pre grams. In 1S7B-79^ eighteen high schODls 
in seven states were evaluatt-d using a pretest*posttest ^ 
experimental-'Ccntrol group dteign. Both experimental and control 
sehools were fflonitored by telephone c^Ul^ and site visits in addition 
to -pre- and posttests. A gr lup of experts in fields related to career 
development and prautice completed 21* page rating instrumeats for 
each participating high schaol. A score describing each school on 
each variable was c^lGulateS by forming the average over the three or 
four raters who rated each ichool* Data were analysed using analysis 
cf covariance (AKCOVA) . Eeswlts showed positive growth or career 
development activities in tl e experimental schools as opposed to the 
controls. It was concluded «that the gains were of sufficient 
magnitude to be nontrivial, and that CPSS addresses an important 
educational need. (Notei tie evaluation focused on the process of 
career developm^ant plannini and activities, not on effects on 
students, \ (KG) 
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II. DEVELOPERt The National Canter for Research in Vocational Eduaation 



I. TITLE OF PRODUCT I The Career Planning Support System (CPSS) 



HI* FUNDINGi National Institute of Education. Testing $340^373 

^ IV. DEVELOPMENT MD TESTING PERIOD^ Davelopmanti 1971-1976; Testingi 1978-1979 

^ V. BRIEF DESCRIPTION OF CPSS 2 

toong the priorities identified by the aareer education movement of the seventies 
were 1) a need to blend student aareer development into the mainstream of educational 
practice, and 2) a need to meet increased accountability demands in the delivery of 
i-P J instructional and counseling service ♦ in public schools* To meet these two needs 

recent research activities have emphasiMd the importance of systems methodQlogy in 
properly planning, implementing, and evaluating career developnent programs (Campbell, 
1975i Campbell et al., 1971; Hosford and Ryan, 1970) • 

Mitchell and Gysbers (1979) reported that an emerging direction for career 
development and guidance in schools is the guidance system comprised of a series of 
interrelated planning, design, implementation, and evaluation components. Herr (1979) 
recommended that guidance at the local school level be based on student needs and 
planned as a total program with goals, objectives, activities, and student outcomes. 
A National Vocational Guidance Association Position Paper on Criteria for Career 
Guidance Programs (1979) stated, "in order to achieve lasting effectiveness, it is 
important that (career development) program planners follow a comprehensive student 
needs-based and evaluation-^oriented approach to program development." 



In resf^nse to the need for systematic program planning for student career 
development programs, the National Center for Research in Vocational Education 
developed and tested CPSS from 1971 to 1973. A two-year (1974-76) field test of CPSS 
resulted in important revisions of the materials. Thirty-eight individual high 
schools , ranging from rural ^ schools of less than 10 0 to large urban and suburban 
schools of more than 2,000 students, participated in the field testing. This 
submission is based on a 1978-79 assessment of CPSS which involved eighteen high 
schools in seven states* The purpose of the assessment study was to test the 
effectiveness of the CPSS materials as a high school career development program 
support system. 

CPSS consists of handbooks, reproducible forms and filmstrlps that describe a 
comprehensive organizational framework and procedural steps a school staff can use to 
cre|Lte an accountable, school-wide high school career development program- The 
swing list describes the complete net of CPSS material si 

® The Coordinator's Training Guide Is a self-instructional training guide for 
the part--time CPSS coordinator, - 

• The Coordittstor ' g Handbook contains instructions that describe step=-by«*step 
0^^^ procedures for managing and implementing CPSS in the high school. 

• Camera- Ready Forms are reproducible copies of each fom needed for the 
Cli^ questionnaires, instructions, CPSS Program Information Pile, etc* 

Handbooks 

The Adyi sor y . Comm ittee Handbook defines the resi^nslbilltiea and duties of 
Advisory Committee m^nbers (five copiei). . ^^^.^ 




Assessing Resources guides a resource leader in directing a task force to 
collect information on and account for tte use of resources in the school 
and eonunmiity. 

Asgessing N^^ss Sur veying provides instruction for preparing^ 
adininistering7'%nd collecting survey quastionnaireg for students, 
graduatas^ parents, and faculty/staf f (five copies). 

Assessing Needs i Tabulation contains instruction on manually tabulating 
data collected by questionnaires (five copies)* 

Analyzing Methods directs a methods specialist about the availability and 
application of guidance methods and how to integrate this knowledge during 
the construction and review of career developnent units* 

The Manual for Writing Behavioral Objectives is a self-instructional 
resource for a behavioral objectives specialist- 

Writing Behavioral Objectives informs the behavioral objectives specialist 
about the function of behavioral objectives in the construction of career 
develupment units. 

Producing Career Development Units (CPUs) provides direction for developing 
career guidanpe/'5evelopnient acti'/ities. 

• Film strip/ Audio Tape Presentations include i 

AV-li "to Orientation to CPSS"--oriants interested parsons to CPSS. 

hV^2i "Shaping program Goals"-^gives an overview of how the needs and 
resources assesOTents lead to goals for a schools 

AV-"3i "Behavioral Objective s"-^accompanies the behavioral objectives 
manual # 

AV^4: "Producing CDUs"--=-gives an overview of the career developnent unit 
process* 

Claims of effectiveness . CPSS is intended as a set of tools to assist with 
institutional changes in planning for career development programs in high schools. It 
is assisned what the school staff using CPSS is motivated to plan for the school's 
career development program. The main claim of this siAmission is stated below. 

Use of the CPSS materials for one academic year enables a high school staff 
to implement a systematic planning process for student career development 
programs. Within the one^-year time interval # the planning process will 
produce student dareer developmant activities and a career development 
program of higher quality than activities and programs that arise nati^ally 
in schools not using CPSS. 

it is important to note that this claim refers to institutional changes in planning 
pmcess and related activities. It currently is not feasible to demonstrate effects 
on student career^developme^ omes» Theory and profess' judcrnnnt . ' owever^ 

strongly suggest that sti^^ =^ l .etit from well^planned lox it programs* 

For toe purposes 
following elemental 



i^mission "systematic jess" includes €he 
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• Establishment of sm organizational structure facilitating a career development 
program, to include clearly designated leadership and pemanent active 
committess and wrk groups* 

• Assesanaent of the career d©valopmont needs of local students and use of the 
.results of the needs assessment in the career davelopnent program* 

• tteation of axplicit career developinent goals reflecting assessed student 
career developrient needs, listed in order of importance* 

• Qreation of student behavioral objec ^vqs designed to implement ' the goals* 

• Creation of student actlylties to achieve the objectives and goals* 

Career development in the CPSS perspective is defined as the process by which an 
individual student acquires the basics nontechnical skills needed for funistioning in 
the world of work, A career development progran is a sequence of activities designed 
to help foster student career development* Studert oareer development activities are 
activites in which students participate to improve their career development skills. 
The quality of the school programs and student activities are defined by judgments 
rendered by a panel of expert judges* 

Intended users of CPSS * hi^jh school personnel and students cooperate in use of 

CPSS, 

Costs to^^choolj * Table 1 shows cost estimates for using CPSS during the first 
year and subsequent years. The figures could be converted to costs per^learner by 
dividing by the number of student users, but this ratio does not seem like a useful 
statistic since CPSS is designed to affect directly the institution/ and the main 
claim of this s^mission refers to institutional change, not learner change. Because 
costs may vary among schools, ranges are entered in the table* 



TABLE 1. COST ESTIMATES Tm SCHOOL 



Personnel 
Staff Training 
Special Facilities 
Equipment 
Consis^ables 
Other Costs 
TOTAL COSTS 



First year 
(Nonrecurring Costs) 
2900--7250 
0 
0 

■ 0 
123 
260 

3283"7633 



Subsequent Years 
(Recurring Costs) 
2175--2900 
0 
0 
0 
61 
60 

2296--3021 



VI. EVIDENCE OF EFFECTIVENESS 



Design of the fielcl test * Data supporting the claim for effectiveness were 
gathered, using a pre^^post, eKperimental-control group design^ on la high schools* 
The high schools were located in'teizona, Maryland, Illinois, Kentucky, Tennessee, 
Florida, and Colorado. Table 2 displays descriptive statistics for the test sites - 
Ten of the 18 participating schools used CPSS for one academic year, and the 
remaining eight did not. In this document CPSS users frequently are referenced as 
experimental schools and nonusers are t med control schools. Measurements on all 
variables related to the - taken before and aft-er — ^ol year in 

which experimental school ? 
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TAB^ 2, CHARACTERISTICS OP TEST SITES 





Control 


Experimental 




Avarage of Characteristics 


Schools 


Schools 


t^ value 


Size of student population 


1916 


1943 


.074 


Ratio of faculty & ataff to student pop- 


19.43 


17.64 


1.540 








• /4o 


Kstimatas of family income 


$12000 


$13125 


.607 


Drop-out rate 


7.4% 


10.0% 


1.375 


Peroent v^ite 


38% 


51% 


*814 


NOTEi Table entries are averages Over the 


control 


or experimental 


SGhOOls, 



labeled* Bcperimental school refers to a school that used CPSS dicing the 
study ^ and control school refers to a school that did not use CPSS. 
*Five schools made SAT scores available^ and the rOTaining 13 submitted ACT averages. 

The five SAT scores were converted to the metric of ACT by dividing them by the 
ratio of the average over schools SAT' to the average ACT. 

Each school provided a part^tijma coordinator who was responsible for the 
preparation and completion of data collection foms and who served as the contact 
person with the National Center staff* In the experimental schools this contact 
person also served as the CPSS coordinator, . The experimental school coordinators 
received a three day training in CPSS procedures in Kovember 1978. The training was 
conducted at the National Center by project staff* Training normally is not necessary 
for use of CPSSi it was provided in this instance to help accelerate the normal 
K.^cess of crjeatin system, in order to complete the study within 

the specified time period. 

loth experimental and control schools were monitored by monthly telephone calls 
and one site visit in February, 1979. This was in addition to pretest and posttest 
site visits to all schools in Nova^er or December of 1978 and May or June of 1979. 
The telephone calls and site visits included very little technical assistance. 
Experimental school coordinators were requested to complete project logs twice a 
month, describing the progress of CPSS in the school* 

Participating schools volunteered in response to a national publicity campaign. 
The original intent was to assign participating schools at randcm to experimental and 
control conditions, but due to insistence of local school administrators random 
assignment occurred in only foia- instances* m the remaining cases^ local school 
officials made the determination* Scparjjnental schools were paid 5000 dollars to 
defray^elcpanses, mo^^ time, tontrol schoois were paid 500 

dollars and given a set of CPSS materials at the end of the study* 

Self selection of schools Into the study at first appears to threaten the 
external validity of the results, but, on reflection, probably poses no such threat. 
All users of CPSS certainly will be self-selected; therefore, the sample is drawn from 
the universe of probable users* Inability to control assignment of schools to 
experimental and control conditions poges some threat to the internal validity of the 
design* The pre-post nature of the design, equivalence of the experimental arid 
control schools on key variables (see Table 2), and the magnitude of the gains for 
experimental schools suggest that the results likely are not due solely to the 
nonrandom assignment, however* The main threat to the internal validity of the study 
is the interaction between those selected into the experimental group and "maturation" 
(i.e., changes toat would occur without the treatanent, but only in experimental 
schools) C Campbell and Stanley, 1966). W?.ile interaction between "maturation" and 
selection cannot be entirely ruled out as a contributing factor^ in ^pertoental school 



gains, the gains reported below are toe large reasonably to he attributed solely to 
the interaction of matiaration and tiie treatoient variable, ^ese gains are all over 
one standard deviation. 

Measurement s Two data colleotion forms ^ the Career DeveloBment Program Status 
Report and toe VeriflGation Checklist, and one rating instrment, the Career 
Development Program Rating Instr™ent, were developed and used for the study* The 
Status Report and Verification CheGklist were used to collect information from the 
field sites* The information was then, reviewed and rated by a fifteen member review 
panel with acknowledged expertise in career development. Thm review panel members 
individually answered questions on the Rating Instrument by referring to information 
collected on the Status Report and verification Checklist for each school. All 
analyses reported in this submission ware based on data drawn frOTi the Hating 
Instrmentp 

The Career Development Program Status Re^rt and the Verification Oiecklist were 
developed by project staff* A review of the forms by external consultants indicated 
that the forms provide information related to the quality of a systematic career 
development program and have content validity. 

The Status Report was completed by school personnel in all schools who docisfiented 
the extent to which their listing career development program planning reflected the 
basic components of systematic career development program planning. These data were 
collected before experimental school coordinators were trained, ^e completed Status 
Report was reviewed on-site by project staff and missing data ware obtained* Samples 
of the type of information collected through the Status Report include data about 
career-education goals ^ asses^ent and evaluation related to career education * and 
student career- development activities. Career development activities include # but are 
not limited tO/ curriculmi units ^ visits to local businesses, and career days.^ 

The Verification Checklist provided a means by which project staff could 
corroborate, clarify^ and expand the information recorded on a school's Career 
Developnent Program Status Report. During the pretest and posttest site visits, a 
National Center staff member completed the checklist with the assistance of school 
personnel, and both persons ' signed the completed form indicating agreement on the 
accuracy of the information, ^Examples of information gathered. on the Verification 
Checklist include data about career-education needs, career-education goals, committee 
organi^^ation related to the career education of students, and quality of student 
career development activities. 

The Rating Instrimient was developed by project staff with the assistance' of an 
external instrmnent design spiuialist. Two factors basic to the design of the rating 
instrunant were ^ (1) inclusion of items that were clearly answerable given the 
descriptive information that was being rated, and ^2) the exclusion of items that did 
not allow control schools a fair opportunity to receive a high rating. 

The toting Xnstrwnent is divided conceptually into two major parts* Part One 
asks questions rjoncerning specific facts describing toe school's career development 
program* Detailed questions are asked about the conduct of needs assesenent, goal 
fomation/ objective witing, student activities, and organisational structurB* 
two contains six sunmary qi^^stions ^Rki r raters to form broad judcpentS/ hame^ 
their ratings in part one, and on ihfonnation provided in tiie Career Dev^ilux r jn. 
Program Status ^^rt and t'- Verification Checklist. 

A g^oup of fifteen emir nt persons in fields related to career development 
research and practice was as? TObled .at the National Center to assist with 
interpretation of the information collected from the field sites. Panelists completed 
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two twenty-one page rating instrments for each participating high school. The first 
completion provided a description of all schools at the beginninf of the school year, 
1978-79 , and the second completion described the career develo^ent prograin in all 
schools at the end of the school year. During the year the experimental schools used 
CPSS materials and the control schools did not. It should be noted that all 
identifying information, e*g,, state , city, school, name, address, and dates had been 
removed frm the data sources prior to the ratings* 

At least three panelists were assigned at randOT to rate each experimental and 
control school* Assigning more than one rater to each school permits numerical 
assessment of reliability of the ratings and yields more accurate results than could 
be obtained from a single rating per school. Pretest and posttest ratings for each 
school were done by the same group of panelists* Panelists were given no information 
about the nature of the design prior to the rating session. In particular, 
experimental and control schools and the pre'-post feature of the design were not 
identified to panelists. in a final debriefing session^ after all rating activities 
had been completed, the panelists were told that they had participated in an 
assessment study of the ^reer Planning Support System. They were given copies of 
CPSS materials, a study abstract, and informed of all aspects of the study. The 
panelists indicated that they had neither surmised the nature of the study nor 
recognized that they had rated pre and ^sttest data frcm the same schools. 

The main reason for use of a panel of judges is related to the nature of the 
stibject matter* Few people v^uld doubt that efficient organisation and planning 
comprise important aspects of high school career development programs. Yet the 
important features of efficient organization and planning remain imcodified in 
sufficient detail to permit completely objective measurement. In such instances, 
human judgments are essential. Hence, a panel of individuals was assembled with the 
eKperience, training^ and reputation to provide the most accurate jud^ents available. 

Because of their importance to the presentation, the six questions addressed by 
the panelists are reproduced verbatim below. 

1. Estimate the extent to whicb the school staff was organized to plan 
systematically a comprehensive career development program by evidence of 
clearly designated leadership; administrative cooperation; and permanent, 
active groups and committees* 

2. Estimate the extent to which a student career development needs assessment 
was conducted, I '' ated, operly interpreted, and the data utilised for 
planning the career development program. 

3* Estimate the extent to which a comprehensive set of ordered career 

development goals reflecting assessed student career develo|.tnent needs were 
developed and used in planning, implementation and evaluation of the 
program. 

4. Estimate the e::ten*: to which a set of behavioral objectives was developQii 
reflecting spe ific goals and containing a clear statement of the intended 
audience, behavior, situation and standard of mastery. 

5* tecimate the extent to which career development activities were developed 
that reflect student needs ^ goals, and associated objectives, and that 
indicate methods , target student group and outcome measures by ref err=ing to 
the tvm attached career development activities. 

6* Based on the available information (including all career developnent 

activities)^ rate tne overall ^ality of the school's career development 
program* 



The first four questions are designed to indicate the degree to which schools had a 
systematic planning process* ^estion five measures the extent to vAiich the school 
had high-quality earear developnent activities for students* The last question 
indicates the quality of the career development program in tht; school. Thus, each 
element in the claim is reflected in these questions* To answer these questions^ 
raters referred to all information on the Status Report and Verification aiecklist 
from each school. Thus, raters had at their disposal data regarding schools* student- 
career development needs and goals, career developnent activities designsd for tase 
with students, and organization of carter-development program planning. Ratings for 
the first five of these items were recorded on a five point scale ranging from 
"limited extent" (scored 0) to "great extent" (scored 4). Ratings on the overall 
quality were also recorded on a five point scale ranging from zero to four, but the 
two extreme points were labeled "very low quality" and "very high quality." 

The unit of analysis for all statistical results is the school* A score 
describing each school on each variable was calculated by foming the average over the 
three or four raters who rated each school. Agreement among raters for a given 
school, thus, indicates the reliability of the scores, and, conversely, disagreement 
among raters indicates unreliability. The discrepancies among raters of a given 
school can be compared to differences in average ratings across schools. This idea 
forms the conceptual basis for calculating reliability coefficients based on an 
analysis of variance model ( se^j Winer, 19712 283f f ) . The idea is to compare a 
mean-square within schools to the mean^square between schools. Since th- object of 
the design is to minimize pretest differences among schcols, these calculations are 
based on posttest scores only. This procedure is quite analogous to calculation of 
reliability coefficients from student scores on a test following a curriculum unit, 
because a "floor" effect artificially deflates reliability calculations derived from 
pretest scores. The point is, that there is very little variance between schools on 
the pretest; all schools score low. The calculations omit consideration of "anchor 
points" (Winer, 1971i 289f f ) , thus yielding somewhat conservative estimates of 
reliability. The formula used approximates an unbiased estimate of reliability, 
assuming no anchor point differences among raters (unlike correlational methods such 
as split half or coefficient alpha, which are biased downward). 

Reliability of these items is unifomly quite high. The nisnerical valupn ran.o 
from *829 to ,932, and average *881 (see Figure 1). 

T \ addition ) r ' bility coefficients based on agreement among different raters 
of the same schools, panelists were asked to estimate their confidence in each rating 
they made. The confidence rating was the same for each question. Rater n re as'^ 1 
to place a check along a scale from zero to 100 indicating thn\.r judgmenrn regarding 
the likelihood that their answers were accurate. The averayf? confidence ratings of 
panelists is quite high, ranging from 87.0 to 91.9 percent, thus reinforcing the 
reusability calculations- In spite of the need for approximate judgments, therefore, 
it ii3 concluded that available evidence is consistent with the view that the 
measu aent^ are accurate to within tolerable limits. 

Data analysis methods . The statis tical method is analysis of eovarlance 
(ANCOVA). The dependent variables for the ANCOVA are posttest scores describing the 
planning process of each school at the end of the experiment. There are two 
independent variables including one categorical factor—experimental condition defined 
by the use or nonuse of CPSS--and one covariate defined as the pretest scor^ 
corresponding to the posttest dependent variabla. Conceptually, the ANCOVAs describe 
-^diffar^nees in posttest scores between schools using CPSS and schools not using CPSS, 
under statistical control for the pretest scores. Although It does not appear to be, 
widely recogniF^efl , the ANCOVA model can be viewed as a model of change. Conceptually, 
the ANCOVA can be viewed as expressing the followiag hypothesis i Change over the 
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Panel 1; Organisation 
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p < .001 

reliability = .852 

average 
conf idence 
racing = 37. 0 



Panel 4: Objectives 




p < .001 

reliability = .900 

average 
confidence 
rating - 90,7 




p < .001 

reliability ^ , 922 

average 
confidence 
racing - 91.9 
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p < .001 

reliability * *850 
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87.9 



Panel 3: Goals 




p < .001 

reliability ^ .932 

average 
confidence 
rating - 91. 5 
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1 6: Overall Quality 

p < .001 



reliability ^ .829 

average 
confidence 
rating ^ 87.7 



FIGURE 1, ANCOVAs, RELIABILITY^ jm CQNFIDENCE RATINGS FOR RTX SU>^iARY MEASli. ..S, 

NOTE I The nijmbar basida each point on the graphs is t jan after data ware 
transformad to standard scoras ( Earn grand maan and . .it variance overall) * 



period of the exparimant is graater for schools using CPSS tha^; for Bchools not using 
CPSS/ whan statistiGal controls for the effect of the starting point (pretest scoras) 
ara applied. 

Results. TOe major results of the study ara sunmarizad in Figure 1, Each of the 
first four, panels of tha figure ijummarize the results for one al^^ant usad to define a 
systamatic career planning procais. Panel five shows results for question five, 
raflacting the quality of the career developmant activities for students. The sixth 
panel simmarigas judgmants of the overall quality. The i^nels of tha figure are 
nuttnbared and labeled to correspond to the questions reproducad on page 6 of this ' 
suhmission* 



Tha graphs display plots of mean diffarances in posttast scores between 
experimental schools (E) and control (c), as adjusted statistically by the analysis of 
covariance for pretest scores on the dependent variable* Alternatively, as noted 
above, these graphs may ba interpreted as diffarences in change from pretest to 
posttast, adjusted for differences in starting point* Thm vertical axes raprasant 
scores on the six items. Thu lefthand point on the horizontal axes (labeled C) 
corresponds to the control group, and the righthand point corrasponds to the 
experimental group ( labeled B) • All six graphs show a substantial positive slope, 
tharaby lending support to the hypotheses* All statistidil tests ara highly 
significant, with probabilities less than .001* ^Reported probabilitias are for the 
main effect of the experimental variable, after adjustment for the covariate.) 
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Whenever random assignment to treatment groups cannot be realized, observed 
differences between treatment groups, in theory can be due to nontreatinent variables. 
The standard methodology for handling jections of this sort is to introduce some 
type of statistical control for a snail group of variables that \tm likely candidates 
to accoujit for observed differences between treatment groups. In the present study 
the treatment variable is defined by the two categories — used CFSS and did not use 
CPSS. Averages on thm following variables ware compared statistically for users and 
nonusers of CPSSi student population size, ratio of faculty and staff to students, 
academic test scores # drop-out rate, percentage of the students who were minority 
group members, and a rough estimate of family income of the students. As shown in 
Table 2, in none of these five tests were statistically significant differences 
observed. Hence, it is concluded that the differences between users and nonusers of 
CPSS on the six criterion variables are not due to any of these five characteristics 
of schools. 

Education al impo rtance * There are two factors related to the educational 
importance of the results- First, are the gains of sufficient magnitude to be 
nontrivial? Seocndly, does CPSS address an important educational need? 

To assess the magnitude of the gains, Figure 1 presents standard scores for each 
point on the graphs* The decimal niHnber beside each point on the graphs is the 
adjusted mean given in standard score units* The calculations were carried out with 
the mean and standard deviation of each variable calculated over preuest and posttest 
and over experimental and control groups- Otlq might prefer using the pretest means 
and standard deviations because these values more accurately reflect the general 
population of schools, the va^t majority of which have not used CPSS. Reliance on the 
overall mean and standard deviation show the results in a conservative li rht, however, 
since the pretest standard deviation is, for every variable, considerably smaller than 
the overall standard deviation* Dividing by the smaller standard deviation would 
magnify differences between experimental and control schools* 

The standard scores reveal that in every instance, after adjusting for pretest 
scores by analysis of covariance, the ^sttest experimental schools are over one 
standard deviation above the grand mean; whereas, posttest control schools are 
one-third to three-fifths standard deviations below the mean. Treatment effects of 
this magnitude are seldom observed in social research. It is concluded, therefore, 
that the magnitude of the standard scores indicates educationally important gains for 
the experimental schools* 

The second aspect of educational significance is the need addres j by CPSS* As 
noted in the opening paragraphs of this submission, the CPSS materials were developed 
in response to a need for improved career development program planning in schools. 
This need has been expressed repeatedly in a variety of professional forums 
representing several professional specialties, prior to development of npss, a 
consensus developed which reported that systematic planning was an essential 
ingredient in improving career development programs- The CPSS materials are designed 
to instruct school staffs in the use of a systematic planning process and development 
of associated products for building career development programs in high, schools* The 
data in this submission demonstrate that the materials do enable staffs to create a 
systematic planning process. 
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